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Abstract 


We  define  time  series  in  m dimensions  x,  as  follows; 
the  observed  variable  z depends  on  ®hd 

t^st  or  z = f(X]_j_,  similarly  n time 

series  in  m variables  z^, . . . z^,  z = f(x)  where  z"f(x,t) 

and  X are  vectors.  This  is  the  discrete  case.  The 
continuous  case  is  similar.  Distinction  is  made  between 
m time  series  in  zero  dimension,  all  on  the  line,  and 
one  time  series  in  m dimensions. 


rirnf^  rJoriec.  in  M-Dlmp'na  loriB 


Definition,  Problems  and  Prospects 

by  Leo  A.  Aroian 

Union  College  and  University 
Schenectady,  New  York 

1.  Introduction 


Thie  purpose  of  this  paper  is  to  define  and  to  consider 
the  problems  and  prospects  of  time  series  in  m dimensions. 
FirsI-,  the  definition  of  time  series  in  m dimensions,  secondly 
its  relationB^llp  to  time  series  in  zero  dimensions,  whether 
stationary  or  not,  and  finally  the  relationship  to  correlation 
theory  in  m dimensions  will  be  considered.  The  author  has 
been  Influenced  by  the  basic  work  of  Box  ard\^nkins  (1970) 

in  prediction  theory.  Their  work  in  the  time  db^nain  and  that 

\ 

\ 

of  others  in  the  frequency  domain  has  forged  an  aij^ost  complete 
solution  of  the  problems  of  time  series  at  a point. \we  are 
extending  their  results  to  time  series  in  m dimensions. 


?.  Definition  - M-Dlmensional  Time  Series 


We  define  a time  series  in  zero  dimensions 
z(t)  = f(t) 

where  t is  time  and  z(t)  is  some  variable  dependent  on  time 
such  as  voltage,  temperature,  wages,  economic  indicators, 
number  of  births,  number  of  deaths,  prices,  crimes,  social, 
business,  industrial,  biological,  medical,  and  environmental 
conditions.  Now  z(t)  may  be  given  continuously  or  at  discrete 


1 ri l.f^ r'va  1;'.  oC  Arif]U,lonally  there  may  he  m zero 

fllmenr.  Lonal  time  Be r lea  namely: 

7,^(t)  = f^(t),  Zp(t)  = ....  z^(t)  = fjjj(t), 

and  Interrelations  such  as 

wherr;  the  z’r  are  any  oC  t?)e  npeclf’tc  variables  mentioned 
previously.  The  time  series  may  be  known  exactly  at  least 
In  theory.  Usually  they  must  be  estimated  and  are  defined 
only  for  -»<ti:t^^,  or  tj^<tst^,  where  t^  is  the  present  time 
and  t^  a time  in  the  past  chosen  for  a particular  reason. 

They  may  be  stationary  or  if  not  may  be  transformed  into 
a stationary  time  series.  Time  series  of  one  variable 
{^’•j^jt],  or  of  two  variables  {z^,Zp,t],  or  m variables 
{ z,  ,7,„, . . . ,z  .tl  are  all  time  series  in  zero  dimensions 
even  in  the  cane  of  m variables.  We  may  be  interested 
in  prediction,  in  the  time  domain,  l.e.  prediction  of  z in  the 
future  based  on  its  past;  or  in  the  power  spectrum  in  the 
frequency  domain. 

What  then  is  the  definition  of  time  series  in  m 
dimensions  or  of  n time  series  in  m dimensions?  Does  the 
definition  include  the  special  case  of  m=0?  The  answer  to 
the  second  question  is  yes.  Our  definition  of  one  time 
series  in  m dimensions  is: 

z(t)  = f(x^,X2,....,Xjjjjt) 

for  -o<t<<»,  or  -*<t<tQ,  Involves  m variables  Xj^,X2, . . . ,Xjjj  and 
time  t,  or  in  all  m+1  Independent  variables.  The  variables 
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may  be  discrete  or  continuous.  We  may  have  two  time  series 
in  m dimensions  and  their  interdependence  illustrated  as 
follows : 

Zi(t)  = 

Z2(t)  = 

or  their  interdependence 

zi(t)  = g^(z2,x^,X2,...,x^;t) 

ZpCt)  = g2(!"^i^Xj^,X2,...,Xj„;t). 

In  general  there  may  be  n time  series  in  m dimensions,  n<m, 
namely  z(t)=f (x;t) , z (t ) and  f(x;t)  vectors  with  n components, 
and  X a vector  with  m components.  Similarly  there  may  be 
any  case  of  dependence  among  the  Zj^.  Vie  do  not  invoke 
stationarity  here,  although  it  is  a helpful  condition  to 
assume  at  the  onset.  It  should  be  clear  then  that  these 
definitions  include  all  the  usual  cases  of  time  series 
in  zero  dimensions. 

Our  definition  may  be  compared  with  the  remarks  of 
Hannan  (1970)  pages  9^-95:  "So  far  we  have  considered  vector 
random  processes  x(t)  in  which  t varies  over  the  real  line 
or  some  subset  of  it.  As  mentioned  in  Chapter  I,  in  some 
applications  t would  in  fact  be  a space  variable,  for 
example  distance  downstream  from  some  fixed  point  on  a 
river  where  x(t)  might  have  three  components  corresponding 
to  the  "velocity"  of  the  river.  ...We  shall  use  v again  to 
indicate  the:  polni,  in  the  platie  so  that  v needs  two 
coordinates  Ko  name  it.  Again  time  variation  may  he  pr-i-nen(, 
so  that  x(v,t)  could  be  considered.  Now  the  argument  of  x(,) 
varies  over  three  dimensional  space."  According  to  our 

- - 


definition,  this  is  a time  series  in  two  dimensions,  or 
three  independent  variables.  We  could  also  have  the 
situation  of  m dimensions,  and  p time  variables  conceptually; 
f^ij  tj]  1=132,. ..jm,  ,j=l,  2 , . . . , p . 

From  another  point  of  view  we  may  have  x variables 
which  may  act  as  time  variables  when  a time  variable 
does  not  occur.  However  t is  a special  type  of  variable. 

Our  definitions  and  models  of  time  series  in  m dimensions 
have  little  or  no  overlap  with  the  treatment  of  Bartlett 
(1975).  Bartlett  (19753  p.vil)  states;  "We  may  divide* 
problems  of  spatial  pattern  (in  contrast  with  complete 
random  chaos)  into  (1)  detecting  departures  from  randomness, 
(ii)  analysing  such  departures  when  detected,  for  example, 
in  relation  to  some  stochastic  model  and  (Hi)  special 
problems  which  require  separate  consideration;  for  example, 
sophisticated  problems  of  pattern  recognition  in  specific 
fields,  such  as  the  computer  reading  of  handwriting  or 
recognition  of  chromosomes."  Our  main  purpose  is  the 
generalization  of  the  prediction  models  of  Box  and  denkins 
from  zero  to  m dimensions. 

3.  Two  Physical  Time  Series  in  M Dimensions 

I shall  give  two  time  series  in  m dimensions:  one, 
the  characteristics  of  the  sun,  and  the  second,  characteristics 
of  a river.  Almost  all  texts  on  time  series  consider  the 
number  of  sunspots  over  time,  z(t)=f(t)  a zero  dimensional 
time  series.  A time  series  in  three  dimensions,  m--33 
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relates  the  number  of  sun  spots  to  regions  on  the  sun, 
eaoh  region  given  hy  spherical  coordinates  on  the  sun 
sa;/  . Thus  y-{t) , the  number  of  sunspots  at 

time  t and  position  (£l>?2»^'-i  ),. where  z(^j^,t)  may 
either  be  autoregressive,  moving  average,  or  a combination 
of  the  two. 

The  river  characteristics  may  be  described  as  a time 
series  either  in  1,  or  2 or  3 dimensions.  If  represents 
the  pollution  at  the  center  of  the  river  at  point  over 
the  whole  length  of  the  river,  then  the  pollution  of  the 
river  is  given  by  z(x^j^,t)  in  this  case.  If  x^^ 
represents  pollution  at  the  width  of  the  river  at  x^^^  and 
x^^  the  depth  of  the  river,  we  obtain  z(x^jl^,x,,j^,x^j^,t) , 
a time  series  in  three  dimensions.  We  do  not  necessarily 
assume  stationarity  in  z in  either  case.  One  of  the 
series  characterize  the  number  of  sun  spots  on  the  sun 
and  the  other  the  pollution  of  a river  in  much  clearer 
fashion  than  is  possible  by  any  time  series  in  zero 
dimensions.  These  models  chow  obviously  that  one  may  use 
time  series  and  statistics  to  model  the  differential  and 
partial  differential  equations  which  underlie  theu(;  phys trial 
phenomena. 

4.  Assumptions  and  Examples 

We  assume  essentially  the  same  conditions  on  z as 
Box  and  Jenkins.  F(z)  the  distribution  of  z,  f(z)  the 
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density  function,  /(^=0,  the  mean,  a^,  the  variance, 
a..,  , the  covariance  function  for  z(t.)  and  z(t.), 
where  t^-t^  is  a constant,  all  exist.  We  further 
assume  z is  stationary.  Later  Box  and  Jenkins  drop  the 
assumptions  of  stationarity  which  we  shall  also  do.  We 
need  to  state  our  assumptions  introduced  by  the  dependence 
of  z on  the  variables  {x^,X2 jX^, . . . ,x^} . For  simplicity 
we  consider  the  case  of  m=2,  with  the  variables  [x^,Xp] . 

In  this  framework  we  measure  z at  (Xj^,Xp)  or  z(x^,x,,). 

The  distribution  of  z,  I''(z)  already  defined  applies  over 
the  /.^,X2-plane.  This  distribution  is  also  the  same 
over  the  set  formed  by  {x^,X2,t},  -®<Xj^<”,  -®<Xp<“, 

_«<t<»,  although  in  practice  we  may  only  know  z for 
tst^.  What  is  of  greatest  interest  is  the  covariance 
structure  in  the  plane  as  compared  with  the  covariance 

structure  as  time  changes.  This  will  be  made  clearer 
in  our  discussion  of  one  simple  model,  the  moving  average, 
MA. 


^xyt'^®00lVyt-l'^®101®-x-lyt-l"®-10l\4lyt-i 
0 1 l^xy-1 1 - 1"^®  0 - ll®'xy +1 1 - l“Vy  t 
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We  replace  by  x and  x^  by  y for  notational  convenience. 
Tf  we  let  all  o’s  except  equal  zero  we  get  the  zero 

dimensional  Marlcov  result 


a model  which  ignores  the  contributions  from  the  other 

points  in  the  x^,X2  plane.  The  a's  are  independently 

2 

distributed  with  mean  zero  and  variance  oj.  Thus 

d 


001"^ '^lOl'*’® 


lOl'^'^Oll'^^O- 
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). 


other  conditions  are  found  involvlnpi  the  coefficients 
of  correlation  in  the  x^^jXg  plane  and  the  correlations 
in  time.  The  correlations  are  between  the  z’s  in  the 
^1*^2  time  t-1;  and  the  correlation  between 

^xyt-1*  These  are  Pqqj^j  PqI*  * ^10*^  ^20**  ^02**  ®-H 
the  other  six  lag  correlations  are  either  equal  to  these 

or  determined  by  these.  The  other  relations  needed  for 
the  determination  of  the  five  0’s  are: 


2 

z^OOl 

‘^a®001 

(^I.^l.l) 

2 

z^lO* 

^a^r)0l(‘’l0l‘’‘® -101^ 

2 

z^Ol- 

2 

" "^a®  001  ^^Oll'*'®  0-11) 

(^1.4.3) 

o 

CM 

c 

CM  N 

" '^a  ^101^-101 

2 

Z^02. 

= '^a®0-ll'’011. 

(n.4.h) 

These  equations  with  (^1.3)  determine  t,h(,-  0'»: 
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®001 

2/ 

" ■'’z/PoOl  a 

(4.5.1) 

®101 

CM  rH 

+ 

1 — 1 
id 

II 

-^+k2)2}/2 

(4.5.2) 

■PlO-'^^OO 

: ' ^2  " '’z^20.^'’a 

®-101 

= {^1  - 

(k^-4kp)5}/2 

®011 

= {k  +(k^ 

; 

-4k;^)^}/2 

(4.5.3) 

II 

on 

P 2 

"'’Ol.'^'^OOl*^^  " °zP02*^'’a 

(4.5.4) 

®0-ll 

= - 

(k2-4k;^)2}/2 

(4.5.5) 

The  other  six  autocorrelations  may  be  obtained  as  functions 
of  these.  The  conditions  k^-4k^^^0,  do  not 

always  hold  in  the  real  domain.  Only  if  we  assume  the 

errors  and  3-_2_oi  ®'011  ^0-11 

may  we  avoid  these  restrictions.  If  k^  -4kp=0, 

0101  = 6_ioi^  ^Oll'^^O-ll* 

What  conditions  must  the  coefficients  of  correlation 

statisfy?  In  this  simple  example 

Pq2,^1“^P  q]^  and  p2o^^l-2p  • Certain  special 

cases  may  be  found  by  eliminating  the  points  (0,1), (0,-1) 

if  0 and  0„  ,,  are  both  zeros,  but  the  problem  must 
011  0-11 

be  reanalyzed  if  the  point  (0,0)  is  missing,  and 
is  zero.  Other  correlations  are  given  by: 

PllO  " '^a(®-101®0-ll^®011®101^  (^4.0.1) 

°z  '’-no"  ^u^®101®0-ll'^-10l'’oil^- 

With  equations  (4.^0  the  autocorrelation  Curie l.i(.xi  is 
completed.  The  eleven  non-zero  covariances  are: 
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Vi.>  ■ 

= E(Zqq^Zqj^^) 

2 

= <^zP 

01. 

^0-1.) 

= °Z002.’ 

10.^10 

) 

• 

.^00. ^ 

" ^^^00.^10.) 

= °z0lO. 

^10.)  = 

= E(z_io.Zo_i.) 

= a^o 

110 

E(2.io 

/oi.) 

" ^(^0-1. ^10.) 

110 

e(2oo- 

1^000 ) 

“ ‘^zPoOl  • 

20. 


} 


and 


The  invertibility  conditions  are  found  by  inversion 
of  (4.1).  The  restrictions  on  the  constants  P,  and 
the  expression  of  (4.1)  as  an  infinite  autoregressive 
time  series  in  and  t are  given  in  the  paper  of 

Aroian, Vo8s,  Oprian  . Discussion  of  autoregressive 
series,  AR,  are  given  in  Aroian,  and  Taneja, 
and  interrelationships  between  AR  and  AM,  and  the  combined 
ARMA  are  given  in  Aroian,  Oprian,  Voss  and  Taneja. 


5.  Problems  and  Prospects 


Are  there  problems  in  m dimensional  time  series 
for  m>0,  which  may  or  mav  not  involve  a single  time 
parameter?  In  such  cases  relationships  in  all  variables 
are  considered  without  respect  to  the  time  variable. 
Consider  the  variable  z the  percent  of  a mineral  available 
at  discrete  positions  there  is  no  time 

parameter  and  z may  be  considered  stationary  as  1 varies 
between  -«  and  ®.  The  steps ize  i would  vary  for  each 
dimension.  A fundamental  problem  in  geology  then  is 
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to  evaluate  z at  delineate  the 

extent  of  a mine.  In  meteorology  we  have  the  temperature 
z,  dependent  on  ^-pi^  ^i*  where  x^,  are  the  coordinates 

of  place  and  t^^  the  time.  In  place  of  the  temperature 
we  may  have  barometric  pressure,  amount  of  rain,  and  other 
variables.  We  may  think  of  a river  face  where  observations 
are  taken  at  fixed  points  at  different  times.  Geometrically 
we  view  the  x^,  x^  plane  moving  along  the  time  axis  t, 
a two  dimensional  time  series.  We  may  be  in  a three- 
dimensional  time  series  if  we  have  additionally  the 
height  or  depth  of  an  observation.  Or  we  may  have  two 
time  series  and  z^,  two  stoms  which  are  interacting 
at  (Xj^,  x^)  x^).  This  is  a case  of  two  time  series  in 
three  dimensions.  Let  us  look  briefly  at  a problem  in 
reading  scores.  We  may  consider  reading  scores  z of 
children  at  time  t dependent  on  coordinates 
variables  influencing  reading  which  may  be  considered 
discrete  and  ordered  in  some  way.  We  may  consider  z 
to  be  the  height  of  a child  as  Influenced  by  x^,x^,,x^ 
and  t variables  at  discrete  points,  x^^^,  x^^^,  and  x.^^ 
and  their  relationship  to  time  - and  looking  I'ot-  cycles 
or  for  increase  or  decrease  in  the  main  variable  z^ 
as  influenced  by  the  x^^.  These  models  include  important 
ones  in  biological  sciences  in  environmental  problems, 
air  pollution,  problems  in  evolution  and  in  medicine  since 
time  is  an  important  variable  in  all  of  these  subjects. 

Thus  we  see  a very  wide  need  and  envisage  an  equally  wide 
use  for  this  statistical  technique.  It  should  bring  more 
understanding  to  (,hese  fields  which  presently  arfj  b»!ing 
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considered  in  a general  way  without  the  benefits  of 
mathematical  and  statistical  Insights.  In  agriculture 
7.  may  be  the  yield  of  a crop  at  place  (x^,x^)  Influenced 
by  variables  X;^  and  x^,  a typical  problem  which 
is  still  not  well  handled  without  the  time  variable  t.  In 
fact  some  geographers  have  already  been  doing  this  particu- 
larly in  space  without  the  time  variable  considered.  Time 
series  will  be  more  informative  than  the  usual  geographic 
block  charts  in  different  colors  or  designs.  Other 
examples  are  earthquakes,  hurricanes,  and  storms  in 
geology  and  meteorology. 

There  is  also  the  domain  of  history,  the  arts, 
sociology,  anthropology  and  their  relationships  to  time 
t.  All  of  the  preceding  discussion  may  be  summarized 
in  the  single  equation 

" ^(^li»^2i»****^(m-l)l,^mi*^^*""^^^"'  -»<t<tQ. 

The  appropriate  Joint  probability  distribution  is  assumed 
for  the  particular  variate  values  of  the  variables.  Researches 
in  this  field  are  clearly  of  the  greatest  Importance  and 
urgency. 

6.  Correlation  Analysis  Versus  Time  Series 

We  may  consider  time  series  in  m dimensions  as 
simply  problems  in  correlation  theory  with  the  appropriate 
variables  and  variate  values  in  a particular  case. 

However  if  our  interest  is  in  cyclical  situations,  stationary 
time  series  or  time  series  which  may  be  transformed  Into 
stationary  time  series  by  use  of  appropriate  operators. 
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are  much  to  be  preferred.  They  provide  useful  models. 

The  two  methods  should  give  the  same  final  results 
but  the  time  series  approach  should  give  more  Insight 
dependent  on  the  particular  model  being  chosen  - 
auloregff.'sslve,  moving  average  or  a mixture  of  these 
i,wo.  Our  result.s  will  be  linear  In  the  variable  - 
wlilcli  may  eliminate  interesting  results  In  the  nonlinear 
case.  However,  nonlinear  time  series  either  stationary 
or  not  should  also  be  considered.  In  other  papers  we 
have  Investigated  the  autoregressive  model  In  m dimensions, 
the  moving  average,  a mixture  of  these,  and  the  resulting 
problems  of  definition,  estimation,  and  the  relationships 
of  these  models  to  each  other.  This  work,  will  Involve 
the  autocorrelation  function  In  m dimensions,  the  cross 
rrorrelatlon  function,  and  the  multiple  coefficient  of 
f:orrelat.lon  function,  all  In  m dimensions. 

7.  Conclusion 

Time  series  In  m-dlmenslons  have  been  defined.  Some 
examples  show  the  Importance  of  the  subject.  The  Inter- 
relationships among  n time  series  In  m dimensions  are  very 
briefly  discussed  for  n^l  and  msl.  Particular  problems 
to  be  Investigated  are  m dimensional  movin'  average  and  auto- 
regressive time  series  and  their  mixtures.  One  AM  model  Is 
discussed  at  length  as  an  example.  The  paper  has  purposely 
been  general  In  order  to  obtain  a very  broad  view  of  this 
subject  and  Its  scientific  importance.  The  relationship 
between  correlation  theory  and  time  series  Is  briefly 
examined.  The  wide  applicability  of  n time  series  in  m 
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dimensions  series  to  the  social  sciences,  the  biological 
sciences,  history,  anthropology,  economics,  environmental 
problems,  and  meteorology  is  indicated. 
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